sore point, a

A sensitive or annoying issue, as in Don't mention diets to Elsie; it's a sore point with her. This idiom was first recorded as a sore place in 1690.